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Abstract 

In this paper we apply computer-aided theorem discovery technique to discover theo- 
rems about strongly equivalent logic programs under the answer set semantics. Our dis- 
covered theorems capture new classes of strongly equivalent logic programs that can lead 
to new program simplification rules that preserve strong equivalence. Specifically, with 
the help of computers, we discovered exact conditions that capture the strong equivalence 
between a rule and the empty set, between two rules, between two rules and one of the two 
rules, between two rules and another rule, and between three rules and two of the three 
rules. 

1. Introduction 

In this paper we apply computer-aided theorem discovery technique to discover theorems 
about strongly equivalent logic programs under the answer set semantics. Our discovered 
theorems capture new classes of strongly equivalent logic programs that can lead to new 
program simplification rules that preserve strong equivalence. 

Theorem discovery is a highly creative human process. Generally speaking, we can 
divide it into two steps: (i) conjecture formulation, and (ii) conjecture verification, and 
computers can help in both of these two steps. For instance, machine learning tools can 
be used in the first step, i.e. in coming up with reasonable conjectures, and automated 
deduction tools can be used in the second step, i.e. in verifying the correctness of these 
conjectures. 

While theorem discovery may make use of learning, these two tasks are fundamen- 
tally different. Theorem discovery starts with a theory, and aims at finding interesting 
consequences of the theory, while learning is mostly about induction, i.e. it starts with 
examples/consequences, and aims at finding a theory that would explain the given exam- 
ples / consequences. 

Using computers to discover theorems is an old aspiration. There have been some 
success stories. For instance, AM (Lenat, 1979) was reported to be able to come up with 
some interesting concepts and theorems in number theory, and the remarkable systems 
described by Petkovsek, Wilf, and Zeilberger (1996) can discover many identities, especially 
hypergeometric identities involving sums of binomial coefficients that are important for the 
analyses of algorithms. Yet another example where "interesting" theorems can be discovered 
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almost fully automatically is a recent work by Lin (2004) on discovering state invariants in 
planning domains. Lin showed that there are ways to classify many state constraints that 
are useful in planning according to their syntactic properties, and enumerate them easily 
for many domains. Furthermore, for many of these constraints whether they are invariants 
can be checked automatically. As a result, the system described by Lin (2004) can discover 
many common constraints in planning domains, and for the logistics domain, it could even 
discover a set of "complete" state invariants. 

Following this line of research, in this paper, we consider the problem of discovering 
classes of strongly equivalent sets of logic program rules under answer set semantics. As 
noted by Lifschitz, Pearce, and Valverde (2001), if two sets of rules are strongly equivalent, 
then we can replace one by the other in any logic program without changing the semantics 
of the program. Thus identifying strongly equivalent sets of logic program rules is a useful 
exercise that may have applications in program simplification. 

This paper is organized as follows. In the next section, we briefly review the basic 
concepts of logic programming under answer set semantics. Then in section 3 we state in 
more precise terms the type of theorems that we want to discover. In section 4 we prove 
some general theorems that will help us prove these theorems, and in section 5, we describe 
some of the theorems that we discovered. We then discuss an application to logic program 
simplification in section 6, and finally we conclude this paper in section 7. 

2. Answer Set Programming 

Traditional logic programming systems like Prolog solve problems by query answering. The 
user encodes knowledge about a domain by a set of rules, and solves a problem by issuing 
queries to the set of rules. In contrast. Answer Set Programming (ASP) (Niemela, 1999; 
Lifschitz, 1999; Marek & Truszczynski, 1999) is a constraint-based programming paradigm. 
It is based on logic programming with answer set semantics (Gelfond & Lifschitz, 1988, 
1991). To solve a problem, the user encodes the domain knowledge as a logic program in 
such a way that the answer sets of the program will correspond to the solutions to the original 
problem. Compared to other constraint-based programming paradigms, ASP allows natural 
encodings of recursive relations, and has built-in facilities for default reasoning. Several ASP 
solvers have been developed (Niemela, Simons, & Syrjanen, 2000; Leone, Pfeifer, Faber, 
Eiter, Gottlob, Perri, k Scarcello, 2006; Lin & Zhao, 2004; Lierler & Maratea, 2004). To 
date, ASP has been used in space shuttle planning (Nogueira, Balduccini, Gelfond, Watson, 
&: Barry, 2001), evolutional linguistics (Erdem, Lifschitz, Nakhleh, &: Ringe, 2003), and 
others. In the following, we briefly review some basic notions in ASP. 

Let L be a propositional language, i.e. a set of atoms. In this paper we shall consider 
logic programs with rules of the following form: 



where /ij's and pj's are atoms in L. So a logic program here can have default negation (not), 
constraints (when k = 0), and disjunctions in the head of its rules. In the following, if r is a 
rule of the above form, we write Hdj- to denote the set {hi, hf^}, Psj- the set {pi, ...,pm}, 
and Ngr the set {pm+i, ■■■,Pn}- Thus a rule r can also be written as Hdr <— Psr,not Ng^. 
The semantics of these programs are given by answer sets (Gelfond & Lifschitz, 1991), which 



hi;---;hk ^-pi,--- 



Pm,notpm+i, ■ ■ ■ 



not p. 



'n 
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are defined by a fixed-point operator tlirougli what lias been known as Gelfond-Lifschitz 
transformation. Let X be a subset of L, and P a logic program. The Gelfond-Lifschitz 
transformation of P on X, written , is the set of rules obtained from P according to the 
following two rules: 

1. If a rule of the form (1) is in P, and pi & X for some m + 1 < i < n, then delete this 
rule. 

2. Delete all literals of the form notpi in the bodies of the remaining rules. 
For instance, if P is the set of following rules: 

a;b 

c <— not a 

then P^"} is {a; b and is {(a; 6 (c ^)}. 

Clearly, for any X and P, P'^ is a set of rules which do not have the ^^not^^ operator. 
Now a set X is an answer set of P if X is a minimal set of atoms that satisfies every rule 
in P-^ , where X satisfies a rule of the form 

hi; - ■ ■ ■,hk ^ Pi, - ■ ■ ,Pm 

if for some I < i < k, hi X whenever {pi, ...,pm} C X. For instance, for the above 
program, both {a} and {b, c} are answer sets, and they are the only answer sets of the 
program. 

Two logic programs Pi and P2 are said to be equivalent if they have the same answer sets, 
and strongly equivalent (Lifschitz et al., 2001) (under the language L), written Pi ~se P2, 
if for any logic program P in L, P U Pi and P U P2 are equivalent (thus we write Pi '^se P2 
when Pi and P2 are not strongly equivalent). For example, {a <— b} and {a <— c} are 
equivalent, but not strongly equivalent. It can be shown that {a <— not a} ~se {<— not a}. 
As in the abstract, we also say that a rule r is strongly equivalent to another rule r', written 
r ~se r', if {r} {^'}) and two rules ri and r2 are strongly equivalent to a rule r, written 
{ri,r2} ~se r, if {ri,r2} ~se {r}, and so on. 

The notion of strong equivalence is important for ASP for several reasons. First of all, it 
helps us understand the answer set semantics. For instance. Turner (2003) showed that the 
disjunctive rule (a; b <— ) is not strongly equivalent to any set of normal rules. This implies 
that there cannot be a modular translation from disjunctive logic programs to normal logic 
programs. However, 

{(a;&H,(^ a, 6)} 

is strongly equivalent to 

{(a ^ not b),(b <— not a), (^ a, b)}. 

This means that under the constraint (<— a, b), the disjunctive rule (a; b ^) can be replaced 
by two rules without disjunction. Secondly, as we mentioned in the introduction, if Pi and 
P2 are strongly equivalent, then they are interchangeable regardless of where they occur. 
Thus if we have a large repertoire of pairs of strongly equivalent logic programs, we could 
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use them to transform a given program into one that is most suitable to the need in hand. 
In particular, it could help us simplify a program for the purpose of computing its answer 
sets. As we shall see, our discovered theorems will contribute significantly to this repertoire. 

Lifschitz et al. (2001) showed that checking for strong equivalence between two logic 
programs can be done in the logic of here-and-there, a three-valued non-classical logic 
somewhere between classical logic and intuitionistic logic. Lin (2002) provided a mapping 
from logic programs to propositional theories and showed that two logic programs are 
strongly equivalent iff their corresponding theories in propositional logic are equivalent. 
This result will be used here both for generating example pairs of strongly equivalent logic 
programs, and for verifying a conjecture. We repeat it here. 

Let Pi and P2 be two finite logic programs, and L the set of atoms in them. 

Theorem 1 (Lin, 2002) Pi ~se P2 iff in propositional logic, the following sentence is valid: 

{f\pDp')D[/\6{r)^ /\ 6{r)], (2) 

pGL rGPi reP2 

where for each p ^ L, p' is a new atom, and for each rule r of the form (1), 5{r) is the 
conjunction of the following two sentences: 

Pl A • • • A A ^p'jn+i A • • • A -.p'„ D /ii V • • • V /ifc, (3) 

P'l^--- ^P'm'\ ^P'm.+1 A • • • A D /I'l V • • • V /I'fc. (4) 

Notice that if m = n = 0, then the left sides of the implications in (3) and (4) are considered 
to be true, and if = 0, then the right sides of the implications in (3) and (4) are considered 
to be false. 

In general checking if two sets of rules are strongly equivalent is coNP-complete (c.f. 
Turner, 2001; Pearce, Tompits, & Woltran, 2001; Lin, 2002). 

3. The Problem 

As we mentioned above, one possible use of the notion of strongly equivalent logic programs 
is in program simplification. For instance, given a logic program, for each rule r in it, 
we may ask whether it can be deleted without knowing what other rules are in P, i.e. 
whether {r} is strongly equivalent to the empty set. Or we may ask whether a rule r in 
P can be deleted if one knows that another rule r' is already in P, i.e. whether {r, r'} 
is strongly equivalent to {r'}. In general, we may ask the following k-m-n question: Is 
{ri, r^., ui, Um} — se {^'i, fk^vi, Wn}? Thus our theorem discovery task is to come 
up, for a given k-m-n problem, a computationally effective condition that holds if and only 
if the answer to the k-m-n question is positive. 

Now suppose we have such a condition C, and suppose that when 

{ri,...,rk,Ui,...,Um} '^se {ri,...,rk,Vi,...,Vn}, 

it is better to replace {ui, Um} by {vi, ...,Vn} in the presence of ri, for the purpose 
of, say computing the answer sets of a program. One way to use this result to simplify a 
given program P is to first choose k rules in P, and for any other m rules in it, try to find 
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n rules so that the condition C holds, and then replace the m rules in P by the simpler n 
rules. 

However, even if checking whether C holds would take a negligible constant time, using 
the above procedure to simplify a given logic program will be practical only when k, m, n 
are all very small or when k is almost the same as the number of the rules in the given 
program, and m and n are very small. Thus it seems to us that it is worthwhile to solve 
the k-m-n problem only when k, m, n are small. In particular, in this paper, we shall 
concentrate on the 0-1-0 problem (whether a rule can always be deleted), the 0-1-1 problem 
(whether a rule can always be replaced by another one), the 1-1-0 problem (in the presence 
of a rule, whether another rule can be deleted), the 2-1-0 problem (in the presence of two 
rules, whether a rule can always be deleted), and the 0-2-1 problem (if a pair of rules can 
be replaced by a single rule). 

An example of theorems that we want to discover about these problems is as follows: 

For any rule r, r iff {Hdr U Ngr) n Psr / 0. (5) 
4. Some General Theorems 

In this section, we prove some general theorems that will help us verify whether an assertion 
like (5) above is true. 

Let L be a prepositional language, i.e. a set of atoms. From L, construct a first-order 
language Fl with equality, two unary predicates Hi and H2, three unary predicates Hdj., 
Psr , and Ngr for each logic program rule r in L (we assume that each rule in L has a unique 
name), and three unary predicates Xi, Yi, and Zi for each positive number i. 

Notice that we have used Hdr, Psr-, and Ngr to denote sets of atoms previously, but 
now we overload them as unary predicates. Naturally, the intended interpretations of these 
unary predicates are their respective sets. 

Definition 1 Given a set L of atoms, an intended model of Fl is one whose domain is L, 
and for each rule r in L, the unary predicates Psr, Hdr, o-nd Ngr are interpreted by their 
corresponding sets of atoms, Psr, Hdr, <ind Ngr, respectively. 

Conditions on rules in L, such as Psr H Ngr 7^ 0, will be expressed by special sentences 
called properties in F^. 

Definition 2 A sentence of Fl is a property about n rules if it is constructed from equality 
and predicates Xi, Yi, and Zi, 1 < i < n. A property <I> about n rules is true (holds) on a 
sequence P = [ri, ...,r„] of n rules if ^[P] is true in an intended model of Fl, where ^[P] 
is obtained from $ by replacing each Xi by Hdr^, Yi by Ps^, and Zi by Ngr^. 

Notice that since ^[P] does not mention predicates Xi, Yi, Zi, Hi, and H2, if it is true in 
one intended model, then it is true in all intended models. 

As we have mentioned above, we are interested in capturing the strong equivalence 
between two programs by a computationally effective condition. More specifically, for some 
small k, m, and n, we are interested in finding a property ^ about k + m + n rules such 
that for any sequence oi k + m + n rules, P = [ri, r^, ui, ...,Um,vi, fn], 

{ri, ...,rk,ui, ...,Um} ^se {n, ...,rk,vi, ...,Vn} iff $ is true on P. (6) 
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We shall now prove some general theorems that can help us verify the above assertion 
for a class of formulas <I>. 

First of all, Theorem 1 can be reformulated in as follows by reading Hi{p) as "p 
holds", and H2{p) as "p' holds": 

Theorem 2 Pi ~se P2 in L iff the following sentence 

yxiH^ix) D H^ix)) D [ f\ 7(r) = f\ 7(0] (7) 

rePi reP2 

is true in all intended models of Fl, where 7(r) is the conjunction of the following two 
sentences: 

\^x{Psr{x) D Hi{x)) A yx{Ngr{x) D ^H2{x))] D 3x{Hdr{x) A Hi{x)), (8) 
\ix{Psr{x) D H2{x)) A 'ix{Ngr{x) D ^H2{x))] D 3x{Hdr{x) A ^2(2;)). (9) 

In first order logic, if a prenex formula of the form 3iNyB is satisfiable, then it is 
satisfiable in a structure with n elements, where S is a formula that contains no quantifiers, 
constants, or function symbols, and n is the length of x if it is non-empty, and 1 when x 
is empty. We can prove a similar result for our first-order languages and their intended 
models here. 

Definition 3 A sentence of Fl is an extended property about n rules if it is constructed 
from equality and predicates Xi, Yi, and Zi, \ < i < n, and Hi and H2. An extended 
property $ about n rules is true (holds) on a sequence P = [ri, ...,r„] of n rules in a model 
M if ^[P] is true in M, where ^[P] is obtained from $ by replacing each Xi by Hdr^, Yi by 
Psn , and Zi by Ng^ . 

Definition 4 In the following, if P = [ri,...,rn] is a tuple of rules in L, and L' is a subset 
of L, then we define the restriction of P on L' to be [r^, ...,r^], where r'- is 

Hdr^ nL' ^ Psr^ n L', not {Ngr^ fl L'). 

Lemma 1 Let $ be an extended property in Fl about n rules, and of the form 3x\/yQ, 
where x is a tuple of w variables, and Q a formula that does not have any quantifiers. If 
<J> holds on a sequence P of n rules in an intended model M of Fl, then there is a subset 
V of L such that L' has at most w atoms ( or one atom when w = 0), and $ holds on the 
restriction of P on L' in an intended model of F^i . 

Proof: Suppose M is an intended model of Fl such that M \= ^\P]- Thus there is a tuple 
p oi w (or one when tt; = 0) atoms in L such that M \= 'iyQ[P]{x/p). Now let L' be the set 
of atoms in p, and M' defined as follows: 

• Each of the predicates Hi, H2, Xi, Yi, and Zi, i > 1, is interpreted as the restriction 
of its interpretation in M on L'. 

• For each rule r in L', the predicates Hdr, Psr, and Ngr are interpreted the same as 
they are in M. This is well-defined as r is also a rule in L, 
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Then M' is an intended model of Fii. Let P' be the restriction of P on L' . Then P' is a 
tuple of rules in L' . Since Q has no quantifiers (and the language has no function symbols), 
for any instantiation u oi y m. L\ M \= Q[P]{x / p){y / u) iff M' \= Q[P']{x / p){y / u) . Since 
M \= yyQ[P]{x/p), we have M' \= ^yQ[P']{x/p), Thus M' [= 3x^yQ[P']. □ 

Using Theorem 2 and this lemma, we can show the following theorem which will enable 
us to automate the verification of the "if" part of (6) when the property <1> is in the prenex 
format. 

Theorem 3 Without loss of generality, suppose m>n. If ^ is a property about k+m+n 
rules of the form 3x\/yQ, where x is a tuple of w variables, and Q a formula that does not 
have any quantifiers, then the following two assertions are equivalent: 

(a) For any sequence of k + m + n rules, P = [ri, r^, ui, u^, vi, if $ is true 
on P, then {n, r^, ui, {n, ...,f„,}. 

(b) (b.l) If n > 0, then for any sequence P = [ri, ...,rk,ui, ...,Um,vi, ...,Vn] of rules with 

at most w + 2(k + m) atoms, if $ is true on P, then 

{ri,...,rfc,Mi,...,Um} '^se , .. ., Tfc , , .. ., f „}. 

(b.2) If n = 0, then for any sequence P = [ri, r^, ui, ...,Um,] of rules with at most 
K atoms, if is true on P, then 

{n, ...,rfc, Ml, ~se {n, 

where K is w + 2k if w + 2k > 0, and K = 1 otherwise. 

Proof: If (a) then (b) is obvious. We assume that (b) is true, and show that (a) holds as 
well. Suppose first that n > 0. Suppose P = [ri, ...,rk,ui, ...,Um,vi, ...,Vn] is a sequence of 
k + m + n rules in a language L such that $ is true on P, and 

{n, ...,rk,Ui, ...,Um} i^se {n, ...,rfc,'L'l, ...,w„}. 

Thus there is an intended model of that satisfies $[-P], and an intended model M of Fi^ 
that satisfies the following sentence: 

(Vx)i^i(x) D i/2(x) A /\ 7(0 = A ^(^)]' 

rePi rGP2 

where Pi = {ri, r^, ui, Um}, and P2 = {ri, r^, fi, As we noted after Defini- 
tion 2, M will also satisfy ^[P]- Thus M satisfies the following sentence 

$[P] A iyx)Hiix) D H2ix) A{[/\ 7(r) A - /\ ^(r)] V [ /\ 7(r) A - /\ 7(r)]}, (10) 

rePi rePs reP2 reP4 

where P3 = {t-i, ...,i;n}, and P4 = {m, ...,nm}. 

Now for any rule r, there is an extended property ip{x, y) of one rule that does not 
mention any quantifiers such that 7(r) is equivalent to 3x, y.ip[r]. Thus for any tuple Q oit 
rules, there is an extended property (p oit rules that does not mention any quantifiers such 
that /\j.^Q^{r) is equivalent to 3y.ip[Q], where y is a tuple of 2t variables. 

Thus there is 
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• a tuple zl of 2{k + m) variables, a tuple £2 of variables, an extended property ipi of 
k + m + n rules that does not have any quantifiers, and whose free variables are in zl 
and £2; and 

• a tuple is of 2{k + n) variables, a tuple vl of variables, and an extended property ip2 
of k + m + n rules that does not have any quantifiers, and whose free variables are in 
is and £4 

such that vi,V2, i^,iM: do not have common variables in them, and (10) is equivalent to the 
following sentence: 

A Vx(i7i(x) D H2{x)) A (3ilVi^2<^i V 3iiVil992)}[i^]. 

Since we have assumed that m > n, thus there is an extended property 993 about k + m + n 
rules that does not mention any quantifiers and function symbols, and whose free variables 
are among ii, ii, and il such that the above sentence is equivalent to the following sentence: 

A ^x{Hi{x) D H2{x)) A 3il(V£2, z-l)^z)[P]- 

Now given the form of <I> assumed in the theorem, there is a tuple 25 oi w + 2{k + m) 
variables, a tuple zq of variables, and an extended property ^ oik + m + n rules that does 
not mention any quantifiers, and whose free variables are among 25, and zq such that the 
above sentence is equivalent to (3i5)(Vi6)^[P]. 

By Lemma 1, there is a subset L' of L that has at most w + 2[k + m) atoms such that 
(3^5) (Vzg)^ holds on P', where P' is the restriction of P on L' . If 

p/ r / / / / / / -1 

^ — Fl) •••) '^fc' ^1' •••> ''^m' ^1' ■^nJ) 

then this will mean that $ is true on P' , and {r[, r^, u'l, u'^} c/^se {r'l, ...,r'f^,v'i, f^}. 
This shows that if (b.l), then (a). 

The proof that if (b.2) then (a) is exactly the same except now that 

[ A ^(^) ^ A ^(")] 

rePi reP2 

is equivalent to 

[ A ^ A ^(")]- 

reP2 rePi 

□ 

The "only if" part of (6) can often be proved with the help of the following theorem. 

Theorem 4 Let Li and L2 be two languages, and f a function from Li to L2. If Pi and P2 
are two programs in Li that are strongly equivalent, then f{Pi) and /(-P2) are two programs 
in L2 that are also strongly equivalent. Here f{P) is obtained from P by replacing each 
atom p in it by f{p). 

Proof: By Theorem 1 and the fact that in propositional logic, if is a tautology, and / a 
function from Li to L2, then f{(p) is also a tautology, where f{(p) is the formula obtained 
from If by replacing each atom p in it by f{p)- □ 

For an example of using the theorems in this section for proving assertions of the form 
(6), see Section 5.1. 
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5. Computer-Aided Theorem Discovery 

Given a k-m-n problem, our strategy for discovering theorems about it is as follows: 

1. Choose a small language L; 

2. Generate all possible triples 



of sets of rules in L such that {ri, rk,ui, Um} ~se {ri, rk,vi, f„} in L; 

3. Formulate a conjecture on the k-m-n problem that holds in the language L, i.e. a 
condition that is true for a triple of the form (11) iff it is generated in Step 2; 

4. Verify the correctness of this conjecture in the general case. 

This process may have to be iterated. For instance, a conjecture formulated in Step 3 may 
fail to generalize in Step 4, so we either need to formulate a new conjecture or start all over 
again in step 1 using a larger language. 

Ideally, we would like this process to be automatic. However, it is difficult to automate 
Steps 3 and 4 - the number of possible patterns that we need to examine in order to come 
up with a good conjecture in Step 3 is huge, and we do not have a general theorem that 
enables us to automate the verification part in Step 4. While Theorem 3 enables us to 
automate the proof of the sufficient part of the assertion (6) for a class of formulas we 
do not have a similar result for the necessary part - as we shall see below. Theorem 4 helps 
a lot here, but it does not provide an automated procedure. Nonetheless, computers play 
a crucial role in all steps, and in the following we report some of the theorems discovered 
using the above procedure. 

5.1 The 0-1-0 Problem 

This problem asks if a given rule is strongly equivalent to the empty set, thus can always 
be deleted from any program. We have the following experimental result: 

Lemma 2 If a rule r mentions at most three distinct atoms, then r ~se iff 



Using Theorem 4, we can show the following result: 

Lemma 3 If there is a rule r of the form (1) such that r c^ge md {Hdr U Ng^) H Psj- ^ 
is not true, then there is such a rule that mentions at most three atoms. 

Proof: Suppose r 0, Hdr H Ps^ = 0, and Psr H Ngr = 0. Suppose L is the set of atoms 
in r, and a, 6, c are three new atoms. Let 



({n, •••,rfe}, {Ui, ...,Um}, {vi,...,Vn}) 



(11) 



{Hdr ^Ngr)n PSr + 0. 




J3 G Hd r 
P € PSr 

otherwise 
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By Theorem 4, we also have /(r) 0- By the construction of /, we also have 

l~l P^f{r) — 0; ^iid ^^f{r) ^ ^9f{r) = ^-^id that /(r) mentions at most three distinct 
atoms. □ 



Theorem 5 (The 0-1-0 problem) Lemma 2 holds in the general case, i.e. without any 
restriction on the number of atoms in r. 

Proof: We notice that the condition in Lemma 2, {Hdr U A'"^',.) fi Psr 7^ 0, is equivalent to 
the following property 



being true on [r]. Thus the "if" part follows from Theorem 3 and Lemma 2. The "only if" 
part follows from Lemma 2 and Lemma 3. □ 

The "if" part of the theorem is already well-known, first proved by Osorio et. al. (2001). 
The "only if" part has also been proved recently by Inoue and Sakama (2004). While we 
did not discover anything new in this case, it is reassuring that the methodology works. 

We notice here that there is no need to consider the 0-n-O problem for n > 1, because 
for any n, {ri,...,r„} is strongly equivalent to iff for each 1 < i < n, {rj} is strongly 
equivalent to 0. 

5.2 The 1-1-0 and the 0-1-1 Problems 

The 1-1-0 problem asks if a rule can always be deleted in the presence of another rule, and 
the 0-1-1 problem asks if a rule can always be replaced by another one. We first solve the 
1-1-0 problem, and the solution to the 0-1-1 problem will come as a corollary. 
We have the following experimental result for the 1-1-0 problem: 

Lemma 4 For any two rules ri and r2 that mentions at most three atoms, {ri,r2} and 
{ri} are strongly equivalent iff one of the following two conditions is true: 

2. Psr^ C Psr^ , Ngr^ C Ngr^ , and Hdr^ C Hdr^ U Ngr^ . 

Lemma 5 // there are two rules ri and r2 such that {r\,r2} —se {^2}, but none of the 
two conditions in Lemma 4 hold, then there are two such rules that mention at most three 
atoms. 

Proof: Suppose there are two rules ri,r2 such that {ri,r2} ~se {^2}, and none of the two 
conditions in Lemma 4 hold. Let L be the set of atoms in ri, r2. 

Without loss of generality, suppose oi is an atom that makes the condition (2) in 
Lemma 4 false. If Ps^j \ {ai} is not empty, let 02 be an atom in it. Let L' = {ai, 02,03}, 
where 03 is a new atom, and / be a function from L to L' as following: 



3x.{Xi{x)\/ Ziix)) AYi{x) 




a = ai 

a G Psr^ \ {fli} 
otherwise 
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clearly, f{ri) and f{r2) mention at most three distinct atoms, and by Theorem 4, 

{/(n),/(r2)}=^.e/(ri). 

We show that none of the two conditions in Lemma 4 hold for f{ri) and f{r2) either. 
We show first that /(r2) ^se 0- By Theorem 5, we need to show that 

S = Ps/(,,,) n {Hdf(r2) U %/(r2)) 

is empty. If ai G S, then by the construction of /, ai G Psr^ H {Hd,.^ UNgr^), a contradiction 
with the assumption that r2 is not strongly equivalent to 0. Similarly, if 02 G S, then by 
the construction of /, 02 G Ps^j D {Hd^^ U Ngr2), a contradiction with the assumption that 
r2 is not strongly equivalent to 0. But then 03 cannot be in S as 03 cannot be in Psf(^j.2)- 
Thus S must be empty. 

We now show that it is not the case that Psj(^^) C Psj(^2)' ^9f(ri) ^ ^9f{r2)^ ^'^d 
Hdf(^ri) — ^'^f{r2)^^9f{r2)- assumption, ai is an atom that makes either Psr^ C ^3^21 

Ngri ^ ^gr2 5 or Hdr-^ C iHrj U iV^r^a false. There are three cases here. Suppose ai makes 
Psri ^ Psr2 false, i.e. ai G but ai ^ Psr-j- Then by our construction of /, we also have 
that ai G Psj(j.j) but ai Psj^^.^). The other two cases are similar. □ 

Theorem 6 (The 1-1-0 problem) Lemma 4 holds in the general case, without any re- 
striction on the number of atoms in ri and r2. 

Proof: The condition in Lemma 4 is equivalent to the following property 

[3x.{X2{x)\J Z2ix)) AY2ix)]y 

{[yx.Yiix) D Y2{x)] A [Vx.Zi(x) D Z2(x)] A [Vx.Xi(x) D (X2(x) V ^2(2;))]} 

being true on [ri, r2]. Thus the "if" part follows from Theorem 3 and Lemma 4, by noticing 
that the above property can be written as 3x\/y.Q as required by Theorem 3. The "only 
if" part follows from Lemma 4 and Lemma 5. □ 

Thus if a rule r2 cannot be deleted on its own but can be deleted in the presence of 
another rule ri, then it must be the case that r2 is redundant given ry. if the body of r2 is 
satisfied, then the body of ri is satisfied as well; furthermore, r2 can entail no more than 
what can be entailed by ri {Hdr^ ^ Hd^^ U Ng^^ ) ■ 

Osorio et al. (2001) proved that {ri, r2} ~se if either Ps^ = and Hdj-^ C Ngr2 

or Psr^ C Psr2, Ngr-^ C Ngr^, and Hdj-j C Hdr2- More recently, Eiter et al. (2004) showed 
that {ri,r2} — se ^1 if s-implies r2 (Wang &: Zhou, 2005), i.e. if there exists a set 
A C Ngr2 such that Hdr^ C Hdr2 U A, Ngr^ C Ngr^ \ A, and Psr^ C Ps^^ • 

As one can see, these are all special cases of the "if" part of Theorem 6. Our result is 
actually more general. For instance, these special cases do not apply to 

{{c b,notc), {^b,notc)} 

and 

{c <— b, not c}, 

but one can easily show that these two sets are strongly equivalent using our theorem. 
^From our solution to the 1-1-0 problem, we can derive a solution to the 0-1-1 problem. 
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Theorem 7 (The 0-1-1 problem) For any two rules ri and r2, ri ^2 iff one of the 

following two conditions is true: 

2. Psr^ = Psr2 , Ngr^ = NQr^ , and Hdr^ U Ngr-^ = Hdj.^ U Ngr2 ■ 

Proof: By Theorem 1, it is easy to see that r\ fi iff {^^ii fi] — se t\ and {ri, —se ^2- 
□ 

Thus two rules ri and r2 can always be interchanged if either both of them can be 
deleted (strongly equivalent to the empty set) or they have the same body, and the same 
consequences when the body is true. For instance, we have {a <— B, not a} ~se {<— -B, not a} 
no matter what B is, because the two rules have the same body, and when the body is true, 
the same consequence - a contradiction. As another example, we have 

{a; h ^ not a} ~se {b ^ not a}, 

because the two rules have the same body, and, when the body is true, the same consequence, 
6. 

5.3 The 2-1-0, 0-2-1, and 0-2-2 Problems 

The 2-1-0 problem asks if a rule can be deleted in the presence of another two rules, the 
0-2-1 problem asks if two rules can be replaced by a single rule, and the 0-2-2 problem asks 
if two rules can be replaced by another two rules. Similar to the previous subsection, the 
solution to the 0-2-1 and 0-2-2 problems will follow from a solution to the 2-1-0 problem. 

The experiment on the 2-1-0 problem was more difficult because as it turned out, we 
have to consider a language with six atoms in this case. In principle, given a language L, 
every subset of L can be the Hd, Ps, or Ng of a rule. Thus when the size of L is six, there 
are in principle (2^)^ — 1 = 262, 143 possible rules, and 262, 143^ triples of them. However, 
we can cut down the numbers significantly with the results that we already have proved. 

First, we only have to consider rules that do not have common elements in any of the 
two sets in {Hd, Ps, Ng}: if either Hd and Ps or Ps and Ng have a common element, then by 
Theorem 5, this rule can be deleted; if Hd and Ng have common elements, then according 
to Theorem 7, we obtain a strongly equivalent rule by deleting the common elements in Hd. 
In the following, we call such rules canonical, that is, a rule r is canonical if 

Hdr n PSr = Hdr H Ngr = PSr H Ngr = 0. 

Secondly, we do not have to consider isomorphic rules: if there is a one-to-one onto 
function from L to L that maps {ri,r2,r3} to {T"i,r2,r'^}, then these two sets of rules are 
essentially the same except for the names of atoms in them. 

Thus by considering only canonical rules and using a certain normal form for triples of 
rules that avoids isomorphic rules, we ended up with roughly 120 million triples of rules to 
consider for verifying the following result, which took about 10 hours on a Solaris server 
consisting of 8 Sun Uhra-SPARC III 900Mhz CPUs with 8GB RAM. 

For more details on the experiment on 2-1-0 problem, please refer to (Chen, Lin, & Li, 
2005). 
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Lemma 6 For any three canonical rules vi, r2 and that mention at most six atoms, 
{ri,r2,r3} {fi,'''2} iff one of the following three conditions is true: 

1. {ri,r3} n. 

2. {r2,r3} r2. 

3. There is an atom p such that: 

3.1 pe {PSri U PSri) n {Hdr^ U Hdr2 U A'fi'ri U M/rz) 

3.2 Hdr^ \ {p} Q Hdy..^ U Ng^^ and Ps^- \ {p} ^ Psj.^ and Ng^- \ {p} C Ng,.^, where 
i=\,2 

3.3 Ifpe Psr^ n Ngr^, then Hdj.^ n Hdr^ = 

3.4 Ifpe Psr2 n Ngr,, then Hdr^ D Hdr^ = 

The following lemma is the reason why we need to consider a language with six atoms 
for this problem. 

Lemma 7 If there are three canonical rules ri,r2 and ra such that {ri,r2,r3} ci^g {i'i,r2}, 
hut none of the three conditions in Lemma 6 hold, then there are three such rules that 
mention at most six atoms. 

Proof: The proof of this lemma is tedious as we have to consider several cases. Consider 
the following statements about any three canonical rules ri^r2,r^: 

(I) {n,r2,r'i} {ri,r2}. 

(II) {ri, r3} 9^,e {r-i}, i.e. Ps,., % Ps,,, or Ng,.^ % Ngr, or Hdr, U Ngr, ^ Hdr, U Ngr, 

(III) {r2, r^} ^se {r2}, i-e. Ps^a 2 Psrs or Ngr^ ^ Ngr^ or Hdr^ U Ngr^ t Hdr^ U 

(IV) {PSri U PSr^) n (i?(ir.i U iHra U iV^^i U iVc/ra) = 

(V) There is an atom p in the set {Psn U Ps^j ) fl {Hdn U i/(ir-2 ^ -^5ri U Ngr2 ) , and another 
different atom q such that one of the following three conditions is true: 

1. q £ Hdr^ U Ngr^ and q i^irg U A'fi'ra- 

2. g S Psri and (7 ^ Ps^y. 

3. (/ E A'^n and q A'^rs- 

Notice that this is the negation of condition (3.2) in Lemma 6. 

(VI) Hdr^ n Hdr^ 2 -Agf^g, and there is an atom p G Ps^ H Ngr2 such that for i = 1,2, 
Hdr^ \ {p} C Hdr., U iV5^3, Ps^, \ {p} C Ps^3, and Ngr^ \ {p} C Ar(^^3. 

Since ri and r2 are symmetric in the conditions in Lemma 6, to prove this lemma, we need 
only to prove the following three assertions: 

(a) If there are three canonical rules ri,r2,r3 which satisfy (I)- (IV), then there are three 
canonical rules r^, rg, rg which mention at most six atoms, and satisfy (I)-(IV) as well. 
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(b) If there are three canonical rules ri,r2,r3 which satisfy (I)-(III)(V), then there are 
three canonical rules r[,r2,r!^ which mention at most six atoms, and satisfy (I)-(III)(V) 
as well. 

(c) If there are three canonical rules ri,r2,r^ which satisfy (I)-(III)(VI), then there are 
three canonical rules f'[,r2,r'^ which mention at most six atoms, and satisfy (I)- 
(III) (VI) as well. 

We now prove the above three assertions one by one. 

(a) Let ai,a2 be two atoms that make (II) and (III) true. If {Psr^ H {Psn UPsr.2)) \{ai, 02} 
is not empty, let 03 be an atom in it. If Psr^\{Psr^ UPsj-j U{ai, 02}) is not empty, let 04 
be an atom in it. If (Psn U Ps^j ) \ (-Rs^a U{ai, 02}) is not empty, let 05 be an atom in it. 
Finally let ag be a new atom different from ai to 05, and L' = {ai, 02, as, 04, 05, ae}- 
Let / be a function from L to L' defined as following: 

a = ai 
a = a2 

a G {Psrs n {Psr^ U PsrJ) \ {ai, 02} 

a € PSrs \ {PSri U PSr2 U {«!, 02}) 
a G {PSr^ U PSr^) \ {PSr-i U {01,02}) 

otherwise 
For each 1 < i < 3, let r- be as follows: 

Ps^/ = Psf{n):Ng^[ = Ngji^n), Hd^[ = Hdj^r^) \ Ngfi^^)- (12) 

We have that 

— For each 1 < i < 3, r- is a canonical rule, and r[ c^se fifi)- Foi' this, we only 
need to show /(r^) c^^se O for each 1 < i < 3. To see this, notice that from 
the definition of /, atoms other than ai and 02 in Ps^-g are mapped to {03,04}, 
and atoms other than oi and 02 in Hdr^, U Ng^-^ are mapped to {05,06}. Thus 
Psj(^3) n (iJi/(,.3) U iV5/(r3)) = 0- By Theorem 5, /(rg) i^^e 0- Now /(n) 9^,^ 
and /(r2) '^se 0, because (II) and (III) hold for /(^i), /(r2), /(ra) by definition 
of/. 

— (I) holds for r[,r2,r'^. This is because by Theorem 4, 

{fin), f{r2), firs)} J^se {/(ri),/(r2)}, 

and for each 1 < i < 3, r- ~<(e /(?"i). 

— (II) and (III) hold for r[,r'2,r'.^. As we mentioned, from the definition of /, (II) 
and (III) hold for /(n), /(r2), /(rg). 

— (IV) holds for r[,r2,r'^. Again, we need only to show that (IV) holds for 
/(ri), /(r2), /(rs). To see this, notice that atoms other than oi and 02 in 
Psr^ U Psr2 are mapped to {03, 05}, and atoms other than oi and 02 in 
Hdri U Hdr2 U Ngr-^ U Ngr2 are mapped to {04, og}. 



fia) 



Ol 

02 

«3 
O4 
05 
Og 



444 



Discovering Classes of Strongly Equivalent Logic Programs 



(b) Again let ai, 02 be two atoms that make (II) and (III) true. Let p, q be the two witness 
atoms in (V). If Pos{r3) \ {ai, a2,p, q} is not empty, let 03 be an atom in it. Let 04 
be a new atom, and L' = {oi, 02, 03, 04,^, g}. Define / as follows: 

a = ai 
a = a2 
a = p 
a = q 

a G Psr.^ \ {ai,a2,p,q} 
otherwise 

Define r[ by (12) as well for each 1 < i < 3. 

— For each 1 < i < 3, is a canonical rule, and ~se /('"i)- This can be seen in 
the same way as for (a) above. 

— By Theorem 4, {/(n), /(r2), /(r3)} {/(^^i), /(?'2)}, and thus 

K,r2,r^} ~se {r'i,r2}. 

So (I) holds for r[,r2,r(^. 

— From definition of /, (II) and (III) hold for /(ri), f{r2), /(^'s), and thus they hold 
for r[,r2, r'^ as well. 

— Again from the definition of /, (V) holds for f{ri), 7(^2), fir^): there is an atom 
p in the set {Ps ff^j-i)^ f{r2)) ^ i^'^firi) ^Hdf(^j.^)UNgj(^j.^-^ [JNgj(^j.^-j), and another 
different atom q such that one of the following three conditions is true: 

1. qe Hdfi^n) U A^^/Cn) and q ^ Hdf^ra) ^ ^^/(ra)- 

2. qe Psf(ri) and q -Rs/(,,3). 

3. qe Ag/(r-i) and q ^5/(^3)- 

(V) holds for 'r[,r2,r'^ as well because for each 1 < i < 3, 

Ps^'^ = Psf(^r,),Ngr'^ = Ngf(^r,),Hdj.'^ U Ng^'^ = Hdf(^r,) U A5/(n)- 

(c) Let ai,a2 be two atoms that make (II) and (III) true. Let p be the witness atom in 
(VI), and let q G Hdr^ fl Hdr^ but q Ngr^. If Pos{r3) \ {ai,a2,p, q} is not empty, let 
03 be an atom in it. Let 04 is a new atom, and Let L' = {ai, 02, 03, 04, p, q}, Define / 
as follows: 



/(«) = { 



ai 


a = ai 


a2 


a = a2 


P 


a = p 


Q 


a = q 


03 


a G Psrs \ {ai,a2,p,q} 


04 


otherwise 



Again define r'- by (12) as well for each 1 < z < 3. 

~ For each 1 < i < 3, r- is a canonical rule, and r- f{fi)- This can be seen in 
the same way as for (a) above. 



/(«) 



ai 

a2 
p 

Q 

as 
04 
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- Again by Theorem 4, {/(n), /(r2), /(rs)} {/(n), /(?^2)}, and thus 

So (I) holds for r[,r2,r'^. 

- Again from definition of /, (II) and (III) hold for /(^i), /(r2), /(ra), thus they 
hold for r[, r^^r'^ as well. 

- By the definition of /, (VI) holds for /(n), /(rs), /(rg): Hdj^^,^) n Hdj^^,.^) % 
Ngf(^rz)-> and there is an atom p e Psf(^ri) ^^9f{r2) such that for i = 1,2, Hdf{j.i) \ 
{p} Q Hdf^rz) U ^5/{r3)> ^s/(rO \ {p} ^ Psf{r^^), and Ngj^r,) \ {p} Q %/(r3)- (VI) 
holds for r[,r'2, Tg as well because 

PSr'^ = PSf^r,),Ngr'^ = Ng f(^r,) , Hd^'. C Hdf^r,)- 

□ 

Theorem 8 (The 2-1-0 problem) Lemma 6 holds in the general case, without any re- 
striction on the number of atoms in ri,r2,r3. 

Proof: The assertion that ri, r2, and are canonical rules and satisfy one of the three 
conditions in Lemma 6 is equivalent to the following property 

[Vx.((-(Xi(x) A yi(x))) A (-(Xi(x) A Zi{x))) A (-(^(x) A Zi(x))))] A 
[yx.{{^{X2{x) A Y2{x))) A {^{X2{x) A Z2{x))) A HY2{x) A Z2{x))))] A 
[Vx.((-(X3(x) A y3(3;))) A {^{X^{x) A Z3(x))) A {^{Ys{x) A ^3(2;))))] A 
{[(Vx.yi(x) D y3(2;)) A (Vx.Zi(x) D Zs{x)) A (Vx.Xi(x) D (X3(x) V Zs{x)))] V 

[(Vx.y2(x) D y3(x)) A {yx.Z2{x) D Z3(x)) a (Vx.X2(x) D (^3(2;) V Zsix)))] V 

px.COiV^x) A (:;OiV2(2;) a CON3{x) a CO Af4(x)]} 

being true on [ri,r2,r3], where COA^l(x) stands for 

(Yiix) V y2(x)) A (Xi(x) V X2(x) V Zi(x) V Z2(x)) 

C0iV2(x) for 

Vy.(x/y) D [(Xi(y) D (X3(y) V Z3(y))) A (yi(y) D y3(?/)) A (Zi(y) D ^3(2/)) A 
(X2(y) D (X3(y) V Z3(y))) A (y2(y) D y3(y)) A (^2(2/) D Z^iy))] 

C0N3{x) for 

yi(x) A Z2(x) D Vy.(-(Xi(y) A ^3(2/))), 

and CO A^4(x) for 

y2(x) A Zi(x) D Vy.(-(X2(y) A X3(y))). 

Thus the "if" part follows from Theorem 3 and Lemma 6, by noticing that the above 
property can be written as BxVy.Q as required by Theorem 3. The "only if" part follows 
from Lemma 6 and Lemma 7. □ 
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The conditions in Lemma 6 (Theorem 8) are rather complex, and the reason why it 
is difficult to automate Step 3 of the procedure at the beginning of the section. These 
conditions capture all possible cases when ra is "subsumed" by ri and r2, and are difficult 
to describe concisely by words. We give some examples. 

Consider the following three rules: 

ri : (a2 ^ ai) 
r2 ■ (as ^ notai) 
r-s : (as ^ nota2). 

We have that {ri,r2,r3} ~se {ri,f2} because the condition (4) in Lemma 6 holds. 

However, if we change r-^ into r'^ : 02 <— not 03, then Pi = {ri, r2,r'^} and P2 = {ri, r2} 
are not strongly equivalent: one could check that condition (4.3) in Lemma 6 does not hold, 
and indeed, while P2 U {oi <— 02} has a unique answer set {03}, Pi U {oi <— 02} has two 
answer sets {03} and {01,02}. 

It is also easy to show by Theorem 8 that 03 ^ not 02 is "subsumed" by 

{(oi; 02; 03 (02; 03 ^ oi)}, 
and 02 ; 03 <— is "subsumed" by 

{(02 ^ ai), (03 ^ notai)}. 

With the results that we have, the following theorem will yield a solution to the 0-2-1 
problem. 

Theorem 9 (the 0-2-1 problem) For any three rules vi, r2 and r^,, {ri,r2} and {rs} are 
strongly equivalent iff the following three conditions are true: 

1. {ri,r2,r3} {n,''2}- 

2. {ri,r^} {?^3}- 

3. {r2,r-i} {rz}. 
For example. We have 

{(02 ^ ai.nota'i), (ai;a2 ^ nota^)} c^^se {^2 ^ nota^}. 

While we have 

{(^ 02,03), as, not 02)} ~se as}, 

we have 

{(ffll ^ 02,03), (oi ^ 03, not 02)} J^se {oi ^ 03}. 

Similarly, we have the following theorem 

Theorem 10 (the 0-2-2 problem) For any four rules ri, r2, r^, r^, {ri,r2} and {rs,rji\ 
are strongly equivalent iff the following four conditions are true: 
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1. {ri,r2,n} c^se {ri,r2}. 

2. {ri,r2,r4} {n,'^2}- 

3. {r3,r4,ri} {r3,ri}. 
4- {r3,U,r2} ~se {^3,^4}. 

6. Program Simplification 

We have mentioned that one possible use of the notion of strongly equivalent logic programs 
is in simplifying logic programs: if P ~se Q, and that Q is "simpler" than P, we can then 
replace P in any program that contains it by Q. 

Most answer set programming systems perform some program simplifications. However, 
only Smodels (Niemela et al., 2000) has a stand-alone front-end called Iparse that can be 
used to ground and simplify a given logic program. It seems that Iparse simplifies a grounded 
logic program by computing first its well-founded model. It does not, however, perform any 
program simplification using the notion of strong equivalence. For instance, lparse-1.0.13, 
the current version of Iparse, did nothing to the following set of rules: 
{(a <— notb),{b <— not a), {a <— a)}. Nor does it replace the first rule in the following 
program {(a ^ not a), (a <— notb), (b <— not a)} by the constraint <— not a. 

It is unlikely that anyone would be intentionally writing rules like a <— a or b a, not a. 
But these type of rules can arise as a result of grounding some rules with variables. For 
instance, the following is a typical recursive rule used in logic programming encoding of the 
Hamiltonian Circuit problem (Niemela, 1999; Marek & Truszczynski, 1999): 

reached{X) <— arc{Y, X),hc{Y, X),reached(Y). 

When instantiated on a graph with cyclic arcs like arc{a, a), this rule generates cyclic rules 
of the form reached{X) ^ hc{X, X) , reached{X) . Unless deleted explicitly, these rules will 
slow down many systems, especially those based on SAT. For instance, none of the graphs 
tested using ASSAT have self-cycles consisting of an arc from a node to itself (Lin & Zhao, 
2004). If these cycles are included, ASSAT would run significantly longer. 

It is thus useful to consider using the results that we have here for program simplification. 
Indeed, transformation rules such as deleting those that contain common elements in their 
heads and positive bodies have been proposed (Brass & Dix, 1999), and studied from the 
perspective of strong equivalence (Osorio et al., 2001; Eiter et al., 2004). Our results 
add new such transformation rules. For instance, by Theorem 7, we can delete those 
elements in the head of a rule that also appear in the negation-as-failure part of the rule. 
Theorems 6, 8, and 9 can also be used to define some new transformation rules. 

7. Concluding Remarks and Future Work 

Donald Knuth, in his Forward to (Petkovsek et al., 1996), said 

"Science is what we understand well enough to explain to a computer. Art is 
everything else we do. ...Science advances whenever an Art becomes a Science. 
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And the state of the Art advances too, because people always leap into new 
territory once they have understood more about the old." 

We hope that with this work, we are one step closer to making discovering classes of strongly 
equivalent logic programs a Science. 

We have mentioned that the methodology used in this paper is similar to that in (Lin, 
2004). In both cases, plausible conjectures are generated by testing them in domains of 
small sizes, and general theorems are proved to aid the verification of these conjectures 
in the general case. However, while plausible conjectures are generated automatically in 
(Lin, 2004), they are done manually here. While the verifications of most conjectures in 
(Lin, 2004) are done automatically as well, they are done only semi-automatically here. 
Overcoming these two weaknesses is the focus of our future work. Specifically, we would 
like to make Step 3 of the procedure in Section 5 automatic, and prove a theorem similar 
to Theorem 3 to automate the proofs of the "only if" parts of theorems like Theorems 5 - 
8, in the same way that Theorem 3 makes the proofs of the "if" parts of these theorems 
automatic. This way, we would be able to discover more interesting theorems in this area, 
and more easily! 
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